Evaluation woes: define metrics from the off

Evaluation Metrics Trade-off for Recommendation Systems

Following the famous Netflix Prize competition, accuracy metrics (such as RMSE) became a de facto standard in the community to evaluate and compare performance of recommendation algorithms. However, it has been shown, that accuracy is not the best way to quantify the quality of recommendations, especially in the context of predicting online performance from offline evaluations [1]. Thus, it mak...

From the EIC: Manufacturing test woes

WITH THE MANUFACTURING CAPACITY of thousands of wafers per week, and thousands of dies per wafer, today's silicon comes out of fab really fast—and furious—sporting device I/Os in the gigabit-per-second range. But it is increasingly going into high-volume and low-cost consumer electronic parts, exhausting the available time and money to test these parts. Little wonder that the 2003 International...

The Woes of an Editor

Williamson's Woes

This is a reply to Timothy Williamson’s paper ‘Tennant’s Troubles’. It defends against Williamson’s objections the anti-realist’s knowability principle based on the author’s ‘local’ restriction strategy involving Cartesian propositions, set out in The Taming of the True. Williamson’s purported Fitchian reductio, involving the unknown number of books on his table, is analyzed in detail and shown...

A Novel Approach to Define Performance Metrics for Students’ and Teachers’ Evaluation

Evaluation is an unavoidable feature in any teaching or learning scenario. The evaluation strategy of students differs widely throughout the world. Further, most of the institutes do not use any objective technique to assess the teaching performance of a teacher. The present paper defines performance metrics both for student and teacher evaluation and also discusses the methodology for calculat...